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[57] ABSTRACT 

In a process for rendering a 3-dimensional graphics scene 
made up of a plurality of static and/or dynamic objects 
composed of geometrical elements, a method for obviating 
redundant processing and communications involved with 
hidden dynamic objects, so as to accelerate the rendering of 
successive images of the scene and to reduce communica- 
tions requirements (FIG. 6C). The method includes in 
respect of each occluded dynamic object: (a) predicting a 
time period during which the object is expected to remain 
occluded; (b) generating a volume that contains the object 
during the time period; (c) inserting the volume into a spatial 
data structure used by an occlusion culling technique; (d) 
applying the occlusion culling technique so as to output- 
sensitively render the scene, yet not rendering or updating 
the occluded dynamic object during the time period, pro- 
vided the occlusion culling technique does not find the 
volume to be visible. 
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^ BEGIN ^ 



FOR EVERY OYNAMIC OBJECT DETERMINE THE 
OBJECT'S INITIAL POSITION AND FIND WHETHER 
THE OBJECT IS VISIBLE AT ITS INITIAL POSITION. 



FOR EVERY DYNAMIC OBJECT WHICH IS INVISIBLE 
AT ITS INITIAL POSITION. CREATE A TEMPORAL 
BOUNDING VOLUME. 



i 



CONSTRUCT A SPATIAL DATA STRUCTURE FOR 
THE STATIC OBJECTS, THE VISIBLE DYNAMIC 
OBJECTS AT THEIR INITIAL POSITIONS, AND THE 
TEMPORAL BOUNDING VOLUMES OF HIDDEN 
DYNAMIC OBJECTS. 



MAINTAIN PRIORITY QUEUE OF THE TIMES AT 
WHICH TEMPORAL BOUNDING VOLUMES ARE 
NO LONGER ASSURED TO CONTAIN THEIR 
RESPECTIVE DYNAMIC OBJECTS. 




FIG.6A 
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FOR EVERY HIDDEN DYNAMIC OBJECT WHOSE 
TEMPORAL BOUNDING VOLUME HAS 
EXPIRED, AND FOR EVERY HIDDEN 
DYNAMIC OBJECT THAT VIOLATED AN 
ASSUMPTION BY WHICH ITS PROBABILISTIC 
TEMPORAL BOUNDING VOLUME WAS 
CREATED. INSERT THE DYNAMIC OBJECT 
INTO THE POTENTIALLY VISIBLE 
DYNAMIC OBJECT UST. 


I 




FOR EVERY DYNAMIC OBJECT ON THE 
POTENTIALLY VISIBLE DYNAMIC OBJECT 
LIST, GET THE DYNAMIC OBJECT'S 
CURRENT POSITION AND INSERT IT 
INTO THE SPATIAL DATA STRUCTURE. 






TRAVERSE THE SPATIAL DATA STRUCTURE, ' 
STARTING AT THE ROOT NODE. (FIG.6C) 


I 




FOR EVERY DYNAMIC OBJECT ON THE 
POTENTIALLY VISIBLE DYNAMIC OBJECT 
LIST WHICH HAS NOT BEEN DRAWN AT 
THE CURRENT FRAME. GET A TEMPORAL 
BOUNDING VOLUME FOR THE DYNAMIC 
OBJECT AND INSERT IT INTO THE 
SPATIAL DATA STRUCTURE. THE VOLUME'S 
VALIDITY PERIOD IS LONGER THAN THE 

VALIDITY PERIOD OF THE PREVIOUS 
TEMPORAL BOUNDING VOLUME FOR THE 
SAME DYNAMIC OBJECT IF THAT VOLUME 
EXPIRED BEFORE IT BECAME VISIBLE. 
SHORTER IN THE OPPOSITE CASE. 







FIG.6B 
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FOR EVERY TEMPORAL BOUNDING VOLUME OF 
A HIDDEN DYNAMIC OBJECT ASSOCIATED WITH 
THE GIVEN NODE OF THE SPATIAL DATA 
STRUCTURE, GET THE DYNAMIC OBJECT'S 
CURRENT POSITION AND INSERT IT INTO 
THE SPATIAL DATA STRUCTURE. 



FOR EVERY OBJECT ASSOCIATED WITH THE 
GIVEN NODE OF THE SPATIAL DATA 
STRUCTURE, DRAW THE OBJECT. 



FOR EVERY CHILD OF THE GIVEN NODE 
OF THE SPATIAL DATA STRUCTURE (FROM 
THE NEAREST TO THE FARTHEST). 
TRAVERSE THE CHILD. 

3 



C END J 



FIG.6C 
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^ BEGIN ^ 



FOR EVERY DYNAMIC OBJECT, INSERT THE 
OBJECT INTO THE POTENTIALLY VISIBLE 
DYNAMIC OBJECT UST. AND GET THE 
DYNAMIC OBJECT'S INITIAL POSITION. 



CONSTRUCT A SPATIAL DATA STRUCTURE 
FOR THE STATIC OBJECTS AND THE 
DYNAMIC OBJECTS AT THEIR INITIAL 
POSITIONS. 




FOR EVERY HIDDEN DYNAMIC OBJECT 
WHOSE TEMPORAL BOUNDING VOLUME 
HAS EXPIRED. AND FOR EVERY HIDDEN 
DYNAMIC OBJECT THAT VIOLATED AN 

ASSUMPTION BY WHICH ITS 
PROBABILISTIC TEMPORAL BOUNDING 
VOLUME WAS CREATED, INSERT THE 
DYNAMIC OBJECT INTO THE POTENTIALLY 
VISIBLE DYNAMIC OBJECT LIST. 



B 



FIG.7A 
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FOR EVERY DYNAMIC OBJECT ON THE 
POTENTIALLY VISIBLE DYNAMIC OBJECT 

UST, GET THE DYNAMIC OBJECT'S 
CURRENT POSITION AND INSERT IT INTO 
THE SPATIAL DATA STRUCTURE. 







TRAVERSE THE SPATIAL DATA STRUCTURE. 
STARTING AT THE ROOT NODE. (FIG.6C) 







FOR EVERY DYNAMIC OBJECT ON THE 
POTENTIALLY VISIBLE DYNAMIC OBJECT 
UST WHICH HAS NOT BEEN DRAWN AT 
THE CURRENT FRAME, GET A TEMPORAL 
' BOUNDING VOLUME FOR THE DYNAMIC 
OBJECT AND INSERT IT INTO THE SPATIAL 
DATA STRUCTURE. THE VOLUME'S VALIDITY 
PERIOD IS LONGER THAN THE VALIDITY PERIOD 
OF THE PREVIOUS TEMPORAL BOUNDING 
VOLUME FOR THE SAME DYNAMIC OBJECT 
IF THAT VOLUME EXPIRED BEFORE IT 
BECAME VISIBLE. SHORTER IN THE 
OPPOSITE CASE. 



MAINTAIN PRIORITY QUEUE OF THE TIMES 
AT WHICH TEMPORAL BOUNDING VOLUMES 
ARE NO LONGER ASSURED TO CONTAIN 
THEIR RESPECTIVE DYNAMIC OBJECTS. 



FIG.7B 
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METHOD FOR DISPLAYING A GRAPHIC bis version of the graphic model can be modified. In such 

MODEL case, it is desirable to minimize as far as possible the volume 

of update data which needs to be communicated to the user's 

FIELD OF THE INVENTION computer, since the communication channel (typically a 

^ . . i j r j- i • 5 network) is usually the major bottleneck in computer sys- 

This invention relates to a method for disphying succes- te ^ ^^ 51e for 

srve frames of a graphics model on a computer screen. may ^ ^ * ^ up6siX J^ ph Tc model at the 

BACKGROUND OF THE INVENTION user's site is not itself displayed but forms the basis for 

further computation and processing, for example, as part of 

The animation picture industry was founded on the real- iQ a j^^fon mac hine. In other words, in all cases the speed 

ization that animation or apparent movement could be of rcn dering graphic images is paramount: the display of the 

achieved by successively presenting to the human eye still ^ may te optional 

images at high frequency, each representing a small incre- ^ foUowing discuss ion of prior art approaches to 

mental movement with respect to its predecessor. Providing • ro - ^ ^ d of ^^ty algorithms, reference will 

the frequency at which the stfll images are presented to the is blowing pubheations: 

human eye exceeds the so-called frequency of fusion , the Heckbert and M. Garland, "Multiresolution modeling 

eye is unable to detect that it is, in reality, seeing only rendering, in Proceedings of Graphics Interface 

discrete images and the eye-brain combination labors under '94 (Banff. Alberta), (May 1994) 

the illusion that it is seeing a continuous, moving picture. 2 y ^ Funkbouser> A cUe nt-server system for 

Modem graphics systems which exploit this fact abound ^ multi-server environments 1 *, in Proceedings of the 1995 

and what all such systems have in common is the capture of Symposium on Interactive 3D Graphics, (Monterey, 

successive frames of digital information which are then Calif.), pp. 85-92, ACM SIGGRAPH, (April 1995). 

displayed on a suitable display screen at sufficiently high 3 N Greene, M. Kass and G Miller "Hierarchical Z-buffer 

frequency. When it is desired to display such images at high visibility", in SIGGRAPH '93 Conference Proceedings, 

resolution, then, of course, the display monitor itself must M (Anaheim, Calif.) pp. 231-238, (August 1993). ACM 

possess a large number of pixels and this in turn demands Computer Graphics, 27(4). 

that each displayed frame of digital image data requires a 4 fi R Naylorf "Partitioning tree image representation and 

large volume of data. In practice, this means not only that generation from 3D geometric models", in Proceedings of 

large memories are required for storing the digital image Graphics Interface '92, (Vancouver), pp. 201-212, (May 

data but, more importantly, that very fast processing is ^ 1992). 

required in order to be able to process each frame of image 5 N Greene and M. Kass, "Error-bounded antialiased 

data presented to the display monitor at a rate no less than rendering of complex environments", in SIGGRAPH '94 

the frequency of fusion, i.e. about 30 Hz. Conference Proceedings, (Orlando, Ha.), pp. 59-66, (July 

A graphics model is generally constructed from static 1994). ACAf Computer Graphics, 28(4). 

objects representing a fixed background scene and one or 3S g q Sudarsky and C. Gotsman, "Output-sensitive visibility 

more dynamic objects which move within the fixed back- algorithms for dynamic scenes with applications to vir- 

ground scene. In practice, a moving picture is derived by tua i reality", in Computer Graphics Forum, September 

generating a large number of frames of pixel data each 1995 (Proceedings of Eurographics '96: Aug. 26, 1996). 

representing slight incremental movements between one 7 r Earnshaw, N. Chilton and I. J. Palmer, "Visuatiza- 

framc and its successor. The visible pixels in each frame 40 i wn and virtual reality on the Internet" in Proceedings of 

represent the instantaneous view of an object as seen by an tne Visualization Conference, (Jerusalem, Israel), 

observer. This instantaneous view is subject to change (November 1992). 

between successive frames owing to the movement of the g jj p Naylor, J. Amanatides and W. C. Thibaull, "Merging 

dynamic objects within the static scene and changing per- £$P trees yields polyhedral set operations", in SIG- 

spective of the viewer. 45 GRAPH '90 Conference Proceedings, (Dallas, Tex.), pp. 

Visibility calculation is one of the most important tasks in 115-124, (August 1990). ACM Computer Graphics, 

computer graphics. Given a geometric model of a scene and 24(4). 

a viewpoint, the goal of visibility calculation (also known as The visibility calculation's runtime can become a problem 

hidden surface removal) is to find which parts of the model with big, complex models featuring large numbers of 

are visible from the viewpoint. The performance of the 50 graphic primitives. Consider, for example, a detailed model 

visibility calculation stage can largely affect that of the entire 0 f a big building. Although, it might include milli ons of 

rendering process because if an element of the geometric polygons, only a small fraction of them will be visible from 

model is found to be invisible then various other rime- any single viewpoint. In such scenes, it would be preferable 

consuming calculations (such as shading, for example) do if the visibility calculation algorithm's runtime were linearly 

not have to be performed for this element 55 proportional just to the number of visible primitives, rather 

It should be noted, however, that whilst visibility calcu- than the total number of primitives in the model, 
lation is normally a precursor to displaying graphic images, A visibility algorithm is called output-sensitive if its 
the display of such images is independent of the visibility runtime per frame (excluding any initialization) is linearly 
calculation and not always performed. Moreover, the proportional to n+f(N) where N is the number of primitives 
enhanced display of graphic images may not be the only 60 in the entire model, n is the number of visible primitives and 
consideration which leads to the desire to speed up visibility f(N) is significantly smaller than N. fi(N) is the (inevitable) 
calculation of graphic images. For example, a graphic model overhead imposed by the algorithm. An output-sensitive 
may be stored in a computer which is remote from a user and visibility calculation algorithm is also called occlusion cull- 
dynamic changes to the graphic model may be performed by ing or visibility culling algorithm. However, most visibility 
an operator located at the remote computer Such changes 65 algorithms are not output-sensitive. For example, the well- 
must be reflected in the model stored locally at the user's site known Z-buffer visibility algorithm is not output-sensitive, 
by sending update information to the user's computer so that because it examines each polygon in the model. Even if 
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every polygon is handled very quickly (e.g. in hardware), the 
runtime is still proportional to the total number of polygons. 

In a recent survey on real-time 3D rendering 1 , Hcckbert 
and Garland claimed that output-sensitive visibility algo- 
rithms are essential in future generation graphics systems. 
Since the Z-buffer visibility algorithm is the most well- 
known and popular visibility algorithm but suffers from the 
drawback that it is not output-sensitive, much recent 
research has been expended to extending the Z-buffer vis- 
ibility algorithm so as to make it outputTsensitive. 

Such research on output-sensitive visibility calculation 
has only begun recently, and has yet to reach commercial 
systems. For example, both SGI's IRIS Performer high- 
performance graphics package and IBM's 3DDC architec- 
tural and mechanical model visualize r incorporate view 
frustum culling and multiple-resolution representations 
(level-of-detail switching) to speed up rendering, but neither 
employs visibility culling. 

If significant parts of the model are dynamic, then its 
complexity becomes even more of a problem. The known 
output-sensitive visibility algorithms become ineffective in 
such cases. Furthermore, in addition to the time it takes to 
render the model's visible parts, considerable time is spent 
just keeping it up-to-date. An example of a large model with 
numerous dynamic objects is an environment which mul- 
tiple users roam simultaneously, such as Funkhouser's 
RING system 2 and Worlds Ina's AlphaWorid. With existing 
visibility algorithms, the model in each user's workstation 
must reflect the other users* current whereabouts. In a 
distributed environment, it might take much time to update 
this model, and even more time to transmit the other users' 
movements over communication lines. 

The use of hierarchical data structures to subdivide object 
space would appear to be an intrinsic property of all output- 
sensitive visibility algorithms: a hierarchical spatial data 
structure is needed to quickly cull large, occluded regions of 
space, without explicitly considering every object within 
those regions. Such an approach is employed in Greene et 
al's hierarchical Z-buffer algorithm 3 and in Naylor's BSP 
tree projection method 4 . However, the spatial data structure 
does not have to be a hierarchy in the strict sense of the 
word. For example, it may be a Directed Acyclic Graph, and 
sibling nodes do not have to represent disjoint regions of 
space. 

The hierarchical Z-buffer algorithm is based on the ordi- 
nary Z-buffer, but uses two hierarchical data structures: an 
octree and a Z-pyramid. The lowest level of the pyramid is 
a plain Z-buffer, in all other levels, there is a pixel for every 
2x2 square of pixels in the next lower level, with a value 
equal to the greatest (farthest) z among these four pixels. 

At the algorithm's initialization stage, an octree is con- 
structed for the entire model. This operation is very time- 
consuming, and takes much longer than just calculating 
visibility from a single viewpoint; however, assuming the 
model is static, the same octree can be used to calculate 
visibility from many different viewpoints. 

To calculate visibility from a viewpoint, the Z-pyramid is 
first initialized to infinity at all pixels in all levels. Then, 
recursively from the octree's root, each encountered octree 
node is checked for occlusion by the current contents of the 
Z-pyramid. If a node is totally bidden, it can be ignored; 
otherwise, the primitives directly associated with the node 
are rendered, the Z-pyramid is updated accordingly, and the 
eight child nodes are traversed recursively, from near to far. 
Because of this front-to-back order, there is a good chance 
that farther nodes will be discovered to be occluded by 
primitives in nearer ones, thus saving the handling of all the 
subtrees associated with the farther nodes. 
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The pyramid is used for fast visibility checking of nodes 
and primitives: find the lowest pyramid level where a single 
pixel still covers the entire projection of the primitive or 
node. If the z value registered at that pixel is closer than the 

5 closest z the projection, then the entire primitive or node is 
invisible. Otherwise, the projection is divided into four, and 
checked against each of the four corresponding pixels in the 
next lower level. 
A more recent version of the hierarchical Z-buffer algo- 

10 rithm proposed by Greene and Kass 5 uses an image-space 
quadtree instead of a Z-pyramid. This worsens performance 
to some extent, but enables effective antialiasing. 

Naylor's projection algorithm performs output-sensitive 
visibility calculation using the same principle as the hierar- 

15 chical Z-buffer algorithm: elimination of large parts of the 
model at an early stage of the calculation, using a data 
structure constructed at preprocessing time. However, Nay- 
lor uses more sophisticated data structures: BSP (binary 
space partitioning) trees. 

20 A BSP tree 4 can be defined in any number of dimensions. 
It is a binary tree, in which each node represents some 
hyperplane; the left subtree of the node corresponds to the 
negative half -space of the hyperplane, while the right sub- 
tree corresponds to the positive half-space. For example, 

25 FIG. la shows the 2D case, wherein each node represents a 
line, and each subtree represents a region in the plane. FIG. 
lb shows the hierarchical relationship of the nodes and 
corresponding regions in the hyperplane starting from the 
root node A. Each region is denoted numerically to distin- 

30 guish from the nodes themselves which are denoted alpha- 
betically. There may also be stored additional data charac- 
terizing each region, such as color data. 

In the 3D case, a BSP tree is a proper generalization of an 
octree: the planes dividing each node do not have to be in the 

35 middle of the node, and are not necessarily axis-paralleL In 
fact, if the model consists entirely of planar, polygonal feces, 
then the BSP tree is general enough to represent the scene 
itself accurately, without need for any additional data struc- 
ture; a boolean "in/out" attribute is simply maintained with 

40 each leaf node. This is in contrast to an octree, which usually 
serves only as an auxiliary data structure in computer 
graphics, and not as a representation of the model itself. 

Nay lor 4 suggests using 2D BSP trees to represent images, 
and scan-converting them into raster images only as a last 

45 stage, for actual display. He presents an algorithm to project 
a 3D BSP tree, representing a scene model, into a 2D BSP 
tree representing its image. This algorithm traverses the 
input BSP tree recursively, from near to far, discarding all 
regions of space occluded by model faces. Output sensitivity 

50 is achieved for the same reason it is attained in the hierar- 
chical Z-buffer algorithm: wholesale elimination of large, 
hidden parts of space, without specifically examining each 
object in these parts. Contrary to the hierarchical Z-buffer 
algorithm, Naylor's projection algorithm needs no further 

55 data structures beyond those representing the model and the 
image. Again, the construction of the hierarchical spatial 
data structure (in this case, the 3D BSP tree) is very 
time-consuming; but it is only constructed once, as a pre- 
processing stage, and subsequently used for visibility cal- 

60 culation from many different viewpoints. 

Both output-sensitive visibility algorithms — hierarchical 
Z-buffer and BSP tree projection— were originally devel- 
oped for static scenes. While Greene et al. suggest a certain 
optimization for animation sequences (yielding aboutx2 
65 speedup after rather significant overhead), these sequences 
are restricted to "walk-throughs", where the whole model is 
static and only the viewpoint may change between frames. 
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For visibility culling algorithms to produce correct results, dynamic object list is created of all potentially visible 

an up-to-date spatial data structure of the model has to be dynamic objects and step (a) includes the steps of: 

used. If any objects in the model move or deform then the (i) initializing the potentially visible dynamic object list to 

underlying data structure may become incorrect, and must contain all dynamic objects and the event queue to be 

be updated. It is not acceptable to construct it again from 5 empty, and 

scratch, because, as mentioned above, this is a very expen- ( u ) constructing a spatial data structure containing the 

sive operation — usually more expensive than rendering a static objects; and step (b) comprises the steps of: 

single frame by the plain Z-buffer algorithm. q inserting the hidden dynamic objects which are no 

It would therefore be desirable to provide an improved longer assured to be contained within their respective 

method for displaying graphic models which adapts visibil- lQ temporal bounding volumes (either because the event 

ity culling algorithms to dynamic scenes, and also utilizes queue so reported or because the objects* changes 

them to minimiz e the update overhead to those parts of the violated some assumption by which the temporal 

model that may be potentially visible to the user. bounding volumes were created) into the potentially 

SUMMARY OF THE INVENTION viable dyna^ object list, and ..,.„, 

(u) obtaining the current position of every object m the 

It is an object of the invention to provide a method for potentially visible dynamic object list and inserting it 

displaying successive frames or images of a graphics scene mto the spatial data structure, 

on a computer screen in which the above drawbacks are The remainder of the method is essentially the same 

reduced or eliminated. except that the potentially visible dynamic object list is 

It is a particular object of the invention to provide an constantly updated as previously hidden dynamic objects 

improved visibility algorithm which allows for faster updat- 20 become visible and as previously visible dynamic objects 

ing of the data structure and thus yields more efficient become hidden. 

processing In order to acnieve optimum performance the spatial data 

According to a broad aspect of the invention there is structure is preferably hierarchical; although degraded 

providedmaprocessforrender^ „ performance, albeit still improved over ^mtherto-proposed 

scene comprising a plurality of static and/or dynamic objects 25 methods, may still be obtained with non-hierarchical spatial 

composed of geometrical elements, a method for accelerat- data structures, e.g ; a fixed grid. 

ing the rendering of successive images of said scene com- 1° accordance with a broad aspect of the invention, there 

prising the steps o£ fa Provided in a process for rendering a 3-dimensional 

(a) ui an initialization step: „ ""Prismg a plurality of static and/or 
* (i) deterrmning which of the dynamic objects are vis- 30 dyiii^ object* composed of geometrical elements a 

1 ible and which are hidden at their initial positions, for obviating redundant processing of hidden 

(ii) creating temporal bounding volumes for the hidden ob J ec * m successive images of said scene so as 
1 dynamic objects consequent to projected motion thereby to accelerate the rendenng of successive images of 

/ <. t - • j a* * _ said scene: the method including m respect of each hidden 

thereof during a respective tune period At not nec- 35 > ^ F 

essarily identical for all dynamic objects, dynamic object: . J A A . ...... ^ A 

(iii) constructing a spatial data structure containing the (*) predicting a time period At during which said hidden 
static objects, the visible dynamic objects at their dynamic object is assummed to remain hidden; and 
initial positions and the hidden dynamic objects' (b) during said time period At, not rendenng said hidden 
temporal bounding volumes, and ^ dynamic object so as to output-sensitively process the 

(iv) maintaining an event queue of the times at which scene. 

the temporal bounding volumes are no longer In accordance with specific embodiment "assumed" 

assured to contain their respective dynamic objects, encompasses also assured. Time period may be expressed in 

(b) inserting the hidden dynamic objects which are no time units or equivalent terms (e.g. number of succesive 
longer assured to be contained within their respective 45 images). 

temporal bounding volumes (either because the event BRIEF DESCRIPTION OF THE DRAWINGS 

queue so reported or because the .objects' motion fa ^ to ^ ^ m how a may 

violated some assumption by which the temporal be ^ m ^ ^ ferred em r^odiments will 

bounding volumes were seated) into the spatial data ^ be ^ of non . limiting example only> 
structure instead of the respective temporal bounding 50 ^ reference to me accompanying drawings, in which: 

volumes, piGS. U and lb is a schematic representation of a prior 

(c) output-sensitively processing the spatial data structure ^ 2D ^ . 

so as to render its visfcle parts and so as to replace > vert ical views of an 

visible temporal bounding volumes by their respective nvw.^^ou . , * A > *u~a 

dynamic objects, 55 during respective stages of a naive update method; 

(d) creating temporal bounding volumes for the hidden * ^OS ^ * P ict ° ria " v verti^ views of an 
dynamic objects which do not already have temporal octree during respective stages of a basic update method; 
bounding volumes, inserting said temporal bounding FIGS. 4a and 46 show pictorially two test scenes used for 
volumes into the spatial database instead of the hidden evaluating the method according to the naive and basic 
dynamic objects and inserting into the event queue the 60 update methods, respectively; 

times at which the temporal bounding volume will no FIGS. Sa and Sb show respectively pictorial representa- 

longer be assured to contain their respective dynamic tions of a 3D object and a temporal bounding volume used 

objects, and in a method according to a second embodiment of the 

(e) repeating steps (b) to (d) for each image to be invention; 

rendered. 65 FIGS. 6a, 6b and 6c are a flow diagram showing the 

In accordance with a particular implementation of such a principal operating steps in a main and subsidiary procedure 

method, in the initialization step a potentially visible associated with the second embodiment of the invention; 
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FIGS, la and lb is a flow diagram showing the principal old and new locations. The node at the root of this subtree 

operating steps associated with the main procedure in a as shown in FIG. 3a is denoted as v=LCA(primitive, new_ 

variation of the second embodiment of the invention; config), as it is the Least Common Ancestor of all the nodes 

FIGS. 8a, Sb and 8c are graphical representations show- which contain the primitive's old and new configurations, 

ing the performance of the algorithm according to the 5 The octree update method now becomes: find v, delete the 

second embodiment of the invention under different condi- dynamic primitive (still at its old position) from the sub- 

rtQQg. octree under v as shown in FIG. 3b, and insert it at its new 

FIG. 9 is apictorial representation of a test scene used for ] ™ iioa into the san« subtree as shown in FIG. 3c. It can 

evaluating the method according to the second embodiment ta proven 4 mat memod B^ correct, ,^e. .t dehvers the same 

of the invention; 10 resu ^ ts ^ me naive method N. It can likewise be shown 0 that 

_ _ ^_ . ... . . .. method B is optimal, in the sense that it does not needlessly 

FIG. 10 is a graphical representation showing theperfor- of ^ Qodes m , he octree (wim ^ ^ ble 

mance of the algonthm according to the second embodiment exception of enrotv leaf nodes) 

of the invention under different conditions for the test scene . t . , , 

shown in FIG 9- and If ihc 001100 15 rcIatIvcI y dcc P» representing a big, com- 

^„ # ^ . . 15 plex model, then vis expected to be closer to the leaves than 

FIG. 11 is a block diagram showing functionally the to ^ r0Qt ^ fc of te al coherence _ eacn 

principal components of a system for carrying out the dynamic location fc expected to ^ dose t0 its place 

invention. at the previous frame; and because the planes separating 

DETAILED DESCRIPTION OF PREFERRED 20 ^ no6ts m f w a ° d ^twccn compared 

BNffiODINffiNTS 20 to the planes separating smaller nodes. Therefore, the prob- 
ability of an object crossing a dividing plane decreases 

The invention is based on the understanding that there exponentially with the height of the nodes separated by that 

exist two ways to update the data structure efficiently: (1) plane. This stands in marked contrast to the case where there 

minimize the time required to update the structure for a is no temporal coherence, and dynamic objects jump ran- 

dynamic object; (2) minimize the number of dynamic 25 domly between frames: in that case, the probability of an 

objects for which the structure has to be updated. Although object crossing a separating plane increases exponentially 

the second approach would appear to be of greater commer- with the height of the nodes. 

cial importance, for the sake of completeness the first Further improvement may be attained by combining the 

approach will also be described. LCA finding stage with the deletion of the primitive from the 

FIGS. 2a, 2b and 2c show pictorially vertical views of an 30 octree, since both operations take place during a bottom-up 

octree during respective stages of a naive update method search of the octree. 

wherein the object is deleted from the octree and then If every primitive may be associated with several octree 

inserted back at its new position. Thus, FIG. 2a shows the nodes (as in the hierarchical Z-buffer algorithm) rather than 

initial model having a static and dynamic primitive respec- 35 with a single node, then this search up the octree begins at 

tively denoted by the white and black circles. Starting from the set of lowest-level nodes with which the object is 

the root of the octree corresponding to the complete outer associated. Each iteration in the search refers to a certain 

square, the octree nodes are successively deleted as shown level in the tree; the set of relevant nodes in that level 

in FIG. 2b so as to delete the dynamic primitive, leaving includes those with which the primitive is explicitly 

only the white circle representative of the static primitive. In ^ associated, as well as ancestors of lower-level associated 

FIG. 2c, the dynamic primitive is re-inserted at its new nodes. The search continues until the set reduces to a single 

location and the octree nodes are re-created. This method, node, then continues as for the case of primitives associated 

which will be denoted as N, is much better than rebuilding with a single node. 

the entire octree, but it is still not optimal: octree nodes are If there is a dynamic object o composed of several 
needlessly deleted and created; furthermore, the search for 45 primitives, they can all be grouped together for the purpose 
the node in which to insert an object takes place over an of finding the least node, v=LCA(o, new_config), contain- 
unnecessarily long path. The update can be optimized by ing all the r^imitives in o at their old and new configurations; 
utilizing the temporal coherence inherent in animation the primitives are deleted from the subtree under v and then 
sequences: consecutive images in the sequence are expected inserted at the new locations. Conversely, under the naive 
to be very similar to each other. An analogous correspon- 5Q algorithm N, it would be better to move primitives to their 
dence exists between the model's states at consecutive frame new positions one by one: the primitives which have yet to 
times: dynamic objects usually do not "jump'* randomly 5© moved can act as place holders, preventing the unneces- 
from place to place around the scene; the position and shape sary deletion of octree nodes. 

of a dynamic object at a certain frame arc expected to be T f there are two dynamic objects, a and b, then it is 

close to its position and shape at the previous frame. 55 worthwhile to group them if the nodes LCA,, and LCA 6 

Therefore, if a primitive is deleted and inserted as per the na coindfc, or if one of them is an ancestor of the other and not 

Ivc method N, it is likely that octree nodes will be needlessly too high above it If there are more than two dynamic 

deleted, only to be immediately created again. objects, they should be grouped so in every group the height 

It should be noted that the octree's depth is not necessarily difference between the LCA's of the different objects is not 

dependent on the number of objects in it By bringing 50 too great, and one of these LCA's is an ancestor of all the 

objects closer together it is possible to obtain an arbitrarily rest 

deep octree. Referring now to FIG. 4a there is shown a first test scene 

FIGS. 3a, 3* and 3c show pictorially vertical views of an used for evaluating the performance of the implementation 

octree during respective stages of an improved update of the octree update algorithm for dynamic primitives asso- 

method B wherein the octree is updated more efficiently by 65 ciated with multiple octree nodes, without grouping. The 

utilizing the fact that the change in the tree is restricted to the first test scene is very simple, consisting of a small cube 

minimal subtree containing the dynamic primitive at both its moving inside a larger one. The small cube was repeatedly 
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moved parallel to the x axis, in steps equal to half its side 
length, such that its distance from the nearest edge of the 
large cube remained equal to the small cube's side length. 
The total octree update time was measured at all steps. The 
octree updating algorithm consistently out performed the na 
Ive algorithm discussed above. The exact speedup achieved 
depended on the ratio of cube sizes; generally, it was found 
to be proportional to the logarithm of the ratio of cube sides. 
This is due to the fact that the depth of the octree depends 
on the proximity be twee d objects in the model. As the small 
cube becomes smaller and closer to the large cube's edge, 
the octree must become deeper to separate the two objects; 
this directly affects the run time of the naive algorithm, but 
has less effect on the bottom-up octree updating algorithm, 
in which most update operations are not dependent on the 
octree's height. 

FIG. 4b shows a second test scene which models a table 
for four, complete with chairs, plates, glasses and candles 
and is more complicated (and more realistic) than the first 
test scene shown in FIG. 4a. The model contains 5745 
geometrical elements (in this particular case polygons), 
resulting in an octree of depth U. The dynamic object for the 
second test scene is again a small cube, this time circling 
around one of the candlesticks in 1° increments. The octree 
update algorithm according to the invention achieved a 
speedup of 2.7 for the second test scene shown in FIG. 4b. 

In contrast to the first test scene shown in FIG. 4a where 
the entire octree was built just for the dynamic object, in the 
second test scene shown in FIG. 4b, almost all of the octree 
is constructed for the static parts of the model. Most of the 
speedup in the second test scene is not the result of elimi- 
nated node deletions, but of a shortened search down the 
octree each time the dynamic object is inserted into the 
octree at a new position. 

Having described the first approach of minimizing the 
time required to update the structure for a dynamic object, 
there will now be described the second approach of mini- 
mizing the number of dynamic objects for which the struc- 
ture has to be updated. Better performance can be achieved 
by considering the purpose for which the spatial data struc- 
ture is being updated. If there is known in advance, for each 
dynamic object, a bounding volume being some region of 
space which completely contains the object for the entire 
duration of the animation sequence, then these volumes can 
be inserted into the model's spatial data structure; a dynamic 
object may be ignored unless the visibility culling algorithm 
finds its bounding volume to be visible. Such bounding 
volumes can be found, for instance, for doors revolving on 
hinges, railroad cars moving on tracks etc. Performance in 
such cases depends on the tightness of the bounding vol- 
umes. In one extreme case, nothing is known about the 
dynamic objects' possible locations, and the bounding vol- 
umes are equal to the entire model space; since these 
volumes are (almost) always visible, each dynamic object 
must be examined at every frame, so visibility calculation is 
not output-sensitive. In the other extreme case, the bounding 
volume is very tight and is identical to the object itself; in 
fact, the dynamic object becomes static, since it has nowhere 
to move, and visibility calculation becomes as output- 
sensitive as it is with a static model 

It is not always possible to find bounding volumes for the 
entire period of the animation sequence; it is particularly 
difficult in interactive applications such as virtual reality 
(VR), simulators and games, where the dynamic objects' 
courses may not be known in advance and the animation 
period might be unlimited. Even if bounding volumes can be 
found, they may be too big and loose, and not contribute 
much toward output sensitivity. 
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Therefore, in accordance with the invention temporal 
bounding volumes (TBVs) are calculated for shorter periods 
of time, rather than for the whole animation sequence. For 
example, if a maximum velocity is known for each dynamic 

5 object, then, given an object's position at a certain time, it 
is possible to compute a bounding sphere for its location at 
any future time. In more general cases, TBVs do not have to 
be spheres — for instance, a dynamic object may have a 
maximum velocity as well as preset tracks, or the maximum 
velocity or resistance to movement might be different in 
different directions. The TBVs are based on some known 
constraints on the possible changes in the dynamic objects, 
e.g. maximum linear and/or rotational velocity and/or 
acceleration, non-penetration through walls and floors etc. 

15 The constraints used to construct the TBVs can be imposed 
by the user interface of an interactive system or by stimu- 
lation rules, e.g. physically-based constraints such as non- 
penetration of solids. The constraints are not necessarily 
absolute, but can be probabilistic; i.e. the objects are not 

20 required to follow these constraints at all times, but are only 
assumed to do so with some degree of probability. The 
possible changes in a dynamic object include any geometric 
modification, including translation, rotation, scaling, 
shearing, change of articulated object configuration and 

^ arbitrary deformation. Generally, it is assumed that there is 
some way to find a bounding volume for each dynamic 
object from the time of the current frame until any desired 
moment in the future. This future moment constitutes an 
"expiration date" for the TBV; the period of time until that 

^ date is the bounding volume's validity period. A dynamic 
object which has been hidden should only be considered if 
its bounding volume becomes visible, or if the volume's 
expiration date arrives, or if the object violated some proba- 
bilistic constraint by which the volume was constructed. 

3S It is to be noted that the temporal bounding volumes arc 
calculated on the fly, and that no prior knowledge of the 1 
objects' trajectories is necessary. Thus we assure compat- 
ibility with interactive applications in which this information 
is not available in advance, such as simulations, games and 

4Q virtual reality (VR). 

Once a dynamic object has been checked and found not 
visible, there remains the problem of choosing the right 
expiration date for its TBV. If the chosen date is too soon, 
then the dynamic object will have to be considered again 

45 before long, thus decreasing efficiency; on the other hand, if 
the date is too far in the future, the bounding volume might 
be too loose, and become visible after a short time. 

If the viewpoint is stationary, and most of the occlusions 
in the scene are by static objects (e.g. walls in a building), 

50 then the optimal validity periods for TBVs can be calculated 
exactly: starting with an initial validity period of one frame, 
repeatedly doubling the period until the bounding volume is 
no longer hidden by static objects, then using binary search 
to find the exact moment at which the volume starts to 

55 become visible. The rendering process must keep an event 
queue of expiration dates, similar to priority queues used in 
simulation. As long as the bounding volumes are tight 
enough, output sensitivity will be maintained, since most 
volumes will remain invisible throughout their validity 

60 period. 

If the viewpoint is not stationary, the method described 
above will not necessarily find optimal expiration dates. 
Since it finds TBVs which are "almost visible", i.e. will 
become visible in just one frame's time, even the slightest 
65 movement of the viewpoint might reveal a part of the 
volume to the viewer, thus necessitating reference to the 
dynamic object Therefore, if the viewpoint is movable, it 
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would be better Dot to use such long validity periods. A 
better choice migbt be to use shorter periods (e.g. by half), 
to get smaller bounding volumes which will take longer to 
be revealed. Alternatively, adaptive validity periods may be 
chosen such that if the last period for a dynamic object's 
TBV were too short (the TBV expired before it was 
revealed), then the next TBV for the same object will have 
a longer validity period; in the opposite case, it will have a 
shorter period. 

TBV technique as described above may be implemented 
in conjunction with the hierarchical Z-buffer visibility algo- 
rithm: TBVs optimize the updating of an octree; the visibil- 
ity algorithm draws the scene using this octree, and detects 
which TBVs have become visible. Dynamic objects should 
either have their trajectories available in advance as an 
animation script, or just have maximum known velocities or 
some other known motion constraint. 

Referring to FIGS. 5a and Sb f the first case is shown 
wherein bounding volumes are constructed as the sweep 
surfaces of the objects' bounding boxes along the trajectory 
curves. Thus, FIG. 5a shows a typical room which forms the 
basis for a graphic model containing a stationary table 
having on opposite sides thereof respective pairs of chairs 
moving towards the table. The closer chair on the left hand 
side of the tabic is subjected to a slight wobble during its 
translational motion towards the table. FIG. 5b shows the 
resulting temporal bounding volume for the four chairs. 

In the second case where only the maximum known 
velocities of the dynamic objects are known, the bounding 
volume for each dynamic object is a sphere centered around 
the object's last known position; the sphere's radius is its 
validity period times the maximum velocity (plus the 
object's radius). Validity periods can be either constant, 
adaptive, or maximal (extending to the end of the animation 
sequence, if it is known). 

FIGS. 6a, 6b and 6c illustrate a flow diagram showing the 
principal operating steps in a main and subsidiary procedure, 
respectively, associated with a first embodiment of the 
invention for accelerating the rendering of successive 
images of a 3-dimensional graphics scene. 

In an initialization step (a) as shown in FIG. 6a y there are 
performed the steps of: 

(i) determining which of the dynamic objects are visible 
and which are hidden at their initial positions, 

(ii) creating temporal bounding volumes for the hidden 
dynamic objects consequent to projected motion 
thereof during a respective time period At not neces- 
sarily identical for all dynamic objects, 

(iii) constructing a spatial data structure containing the 
static objects, the visible dynamic objects at their initial 
positions and the bidden dynamic objects* temporal 
bounding volumes, and 

(iv) maintaining an event queue of the times at which the 
temporal bounding volumes are no longer assured to 
contain their respective dynamic objects. 

Thereafter, in step (b) the bidden dynamic objects which 
are no longer assured to be contained within their respective 
temporal bounding volumes (either because the event queue 
so reported or because the objects' changes violated some 
assumption by which probabilistic temporal bounding vol- 
umes were created) are inserted into the spatial data struc- 
ture instead of the respective temporal bounding volumes. 

Subsequently, in step (c) shown as separate subsidiary 
procedure in FIG. 6c, the spatial data structure is output- 
sensitrvely processed (traversed) so as to render its visible 
parts and so as to replace visible temporal bounding volumes 
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by their respective dynamic objects. In the case where the 
spatial data structure is hierarchical, the traversal is a recur- 
sive procedure; whilst in the case where the spatial data 
structure is non-hierarchical as in a regular grid, the traversal 

5 is iterative. In step (d) temporal bounding volumes are 
created for the hidden dynamic objects which do not already 
have temporal bounding volumes and these are inserted into 
the spatial database instead of the hidden dynamic objects. 
The times at which the temporal bounding volume will no 

10 longer be assured to contain their respective dynamic objects 
(the "expiry times") are then inserted into the event queue. 
Thereafter, steps (b) to (d) are repeated for each image to be 
rendered. 

It should be noted that the term event queue should be 

15 constued in a logical sense, i.e. it is not bound to any specific 
data structure relaization. 

Reference is now made to FIG. 7 which is a flow diagram 
showing the principal operating steps according to a varia- 
tion of the main procedure described above with reference to 

20 FIG. 5a of the drawings. The essential difference between 
the two embodiment lies in the manner in which dynamic 
objects are initially distinguished as being hidden or poten- 
tially visible. In the embodiment shown in FIG. 6a, this is 
determined explicitly during the initialization step (a). In the 

25 variation shown in FIG. 7, the initialization step (a) creates 
a potentially visible dynamic object list of all potentially 
visible dynamic objects and inserts all the dynamic objects 
therein. During subsequent processing for rendering the first 
image, it becomes apparent that actually some of the 

30 dynamic objects in the potentially visible dynamic object list 
are, in fact, hidden, and the potentially visible dynamic 
object list is updated accordingly. Since, in this case, no 
explicit distinction between hidden and potentially visible 
dynamic objects is made in the initialization step (a), the 

35 initialization itself is faster. However, this is at the expense 
of initially more processing during the traversal procedure 
(step (c) while rendering the first image. 

The performance of the temporal bounding volume tech- 
nique (TBV) was compared to that of the hierarchical 

40 Z-buffer algorithm, updating the octree for each dynamic 
object at every frame (HZB), and to simply render all the 
objects at every frame by an ordinary Z-buffer (ZB). All tests 
were carried out on an SGI IRIS Indigo XS24 4000 work- 
station with a hardware Z-buffer, using the GL library for 

45 display. The scene models used in the tests were buildings 
consisting of interconnected rooms, each furnished with a 
table; the dynamic objects were chairs which followed 
trajectories approaching the tables as shown in FIG. 4a. To 
test the net improvement gained by the TBV technique, the 

50 octree was updated naively by both TBV and HZB. 

FIGS. 8a, Sb and 8c are graphical representations show- 
ing the performance of the algorithm according to the 
invention under different conditions. FIG. 8a shows the 
performance of the three techniques for models of increasing 

55 size, having a varying number of static polygons and the 
number of dynamic polygons being fixed at 1100. As can be 
expected, ZB's runtime is linear in the size of the model, 
while those of HZB and TBV are nearly constant since the 
same number of objects are visible regardless of the model's 

60 size. TBV does slightly better because only half of the 
dynamic objects are actually visible. 

In FIG. fU>, the performance of the three techniques is 
compared for models of increasing size, where the ratio of 
the number of dynamic objects to the total number of objects 

65 in the model is fixed to a constant 80%. Thus there are 
always four moving chairs in each room. In this case, both 
ZB and HZB have a linear runtime with respect to the size 
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of the model; HZB does much worse than ZB because of the 
need to keep the octree up-to-date, incurring considerable 
overhead. TBV eliminates many of these octree updates, 
thus improving performance considerably. 

FIG. 8c presents the results obtained by the three tech- 5 
niques for increasing numbers of dynamic objects within a 
static model of fixed size comprising 125 rooms and tables 
represented by 16,250 static polygons and a varying number 
of dynamic polygons. This demonstrates that the perfor- 
mance gain achieved by TBV increases with the proportion 1Q 
of dynamic objects in the model. 

It will thus be seen that the TBV algorithm according to 
the invention is superior to existing visibility algorithms, 
most notably when most of the scene polygons are dynamic. 

The TBV technique eliminates the need to update the 
visibility algorithm's underlying data structure (octree or 15 
BSP tree) for most dynamic objects, namely those which are 
invisible and with a TBV that is still valid. However, the 
technique has another, very important advantage: in addition 
to the auxiliary data structure, the scene model itself does 
not have to be updated for these hidden objects, but can be 20 
left with their old configurations and properties. This may 
save a significant amount of calculation if these objects 
exhibit complex behaviors, deformations etc. In the model, 
the data about these objects will be incorrect, but this will 
not matter since they are invisible anyway. 25 

Consider a multi-user virtual environment, e.g. Funkhous- 
cr's RING system 2 . Many users can roam simultaneously 
through a shared 3D virtual building, seeing each other as 
graphic representations in the appropriate places in the 
building. In a client-server configuration, each user's work- 
station acts as a client, and a central server (or a network of 
servers) updates each client as to the geometry it might see; 
some of this geometry may depend on other clients. The 
server itself is constantly updated of every user's geometry. 
Using the TBV technique, some communication can be 
saved: the server can keep TBVs for those users which are 
currently not seen by any other user; it will only request 
geometry updates from those clients that become potentially 
visible, or whose TBV expires. Alternatively, the server can 
have each pair of clients establish a peer-to-peer communi- 
cation channel between them when they first see each other. 
Each client then performs its own visibility calculation; 
when the TBV technique determines that another user may 
become visible, an update is asked of that other user's client 
through the peer-to-peer link. 

TBVs can eliminate still more communication overhead 
in a distributed VR system with no central server, such as the 
VRMUD environment described by Eamshaw et al. 7 or with 
a server that holds only the static parts of the model. Instead 
of having every station broadcast its user's movements and 
deformations, each station can specifically keep track of just 
those other users which may be visible to it. For all the other 
users it will keep TBVs, and request a geometry update once 
a TBV expires or becomes potentially visible. 

The algorithm has been implemented by extending the 
hierarchical Z-buffer algorithm to dynamic scenes, 
described in detail above with particular reference to FIGS. 
6a and 6b of the drawings. Currently the system executes on 
a single workstation: the viewpoint moves through the scene 
at the user's control, and all the other users are simulated by 
the program. 

FIG. 9 shows another test scene used to test the perfor- 
mance of various rendering techniques using a Silicon 
Graphics Indy R5000. The number of static objects and the 
number of visible dynamic objects were kept constant at 
13,220 and 14,946 polygons, respectively; the number of 
hidden dynamic objects was varied by adding men inside the 
building. 
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FIG. 10 shows that the runtime of the plain Z-buffer 
algorithm (ZB) is linearly proportional to the total number of 
objects in the scene. The hierarchical Z-buffer algorithm 
(HZB) requires that the octree be updated for every dynamic 
object, and therefore does even worse than ZB. The TBV 
technique according to the invention updates the octree only 
for the visible dynamic objects, and its runtime is almost 
constant in comparison to ZB and HZB. 

It will be appreciated that whilst the preferred embodi- 
ment has been described with particular reference to 
dynamically updating an octree database structure, the 
invention is equally applicable to other database structures: 
both hierarchical and non-hierarchical. The modification 
with regard to non-hierarchical spatial data structures, such 
as regular grid structures, has already been discussed above 
with reference to FIG. 6b of the drawings. 

However, it is to be noted that other hierarchical spatial 
data structures are also contemplated by the invention. For 
example, the invention can be used to dynamically update a 
BSP tree which is subsequently displayed by Naylor's 
visibility culling algorithm 4 . However, this is not a straight- 
forward generalization of the same technique, because BSP 
trees are inherently different from octrees and k-D trees: 
BSP trees (with leaf "in/out" attributes), as used by the 
visibility algorithm, represent the objects themselves, 
whereas octrees and k-D trees are merely auxiliary data 
structures, supplementing a boundary representation. 

In order that the visibility algorithm be output-sensitive 
with respect to the number of dynamic objects, the following 
data structures are maintained: 

D a set of all the dynamic objects, each having a unique 
identifier (ID) and a time of last observation. Those of the 
dynamic objects that are hidden also have a TBV, speci- 
fied by a BSP tree; an expiration time for the TBV; and a 
set of pointers to the leaves of S (see below) that intersect 
the TBV. 

S a BSP tree that is the union of the static scenery and the 
TBVs of hidden dynamic objects in D. A set of dynamic 
objects IDs is associated with each leaf of bf S; an object's 
ID is in the set if it is invisible and its TBV intersects the 
leaf. 

T a BSP tree that represents the entire scene, including the 
static scenery, visible dynamic objects and TBVs of 
hidden dynamic objects. Each leaf of T has a set of 
dynamic object IDs; an ID is in the set if the correspond- 
ing dynamic object is either visible and intersects the leaf, 
or hidden and its TBV intersects the leaf. 
Q an event queue of TBV expiration events for hidden 
dynamic objects. 
50 V a set of IDs of visible dynamic objects. 

Each of the "dynamic objects" referred to above can be 
either an avatar of some other user or an autonomously 
moving object, controlled by a program, e.g. Java-controlled 
objects in VRML 2.0 models. 
55 The algorithm uses two subroutines: del__TBV (delete 
temporal bounding volume) accepts an ID of a hidden 
dynamic object, and changes the object's status from hidden 
to (potentially) visible; uni_vis (unite a visible object into 
the scene) handles a visible object. 
60 del_TBV(ID): 

1. Delete ID from the leaves of S that contain ID. 

2. Merge leaves of S if possible. 

3. V«-VU(ID). 
In step 1 of del_TBV, the leaves of S which contain ID 

65 are given by the set of leaves maintained with the corre- 
sponding dynamic object in D. In step 2, the leaves that 
should be merged are siblings that contain the same set of 
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IDs after the deletion of step 1. The merge proceeds bottom- requires special care, because it traverses an hierarchical 

up, terminating at siblings that are either not both leaves or data structure and modifies it at the same time. Therefore we 

have different ID sets. postpone merging sibling leaves that contain the same set of 

uni_vis(ID): IDs until we're about to backtrack from their parent Note 

1. Obtain a BSP tree B representing the current configuration 5 also that the union operation in step 4(b) preserves the 
of the dynamic object corresponding to ID. overall structure of the BSP tree, but might replace leaf 

2. T*-TUB. During the union, insert ID into every leaf of T nodes with subtrees; if this happens, the new subtree should 
that B intersects. be traversed too. 

In step 1 of um_vis, B can be obtained, e.g., through a Finally, step 5 handles dynamic objects which cease being 

communication Hnk The exact content of the communica- 10 visible. If such an object is controlled by another station, 

tion may depend on the nature of the dynamic object. For then that station should provide a BSP tree representing the 

example, if the object is rigid, then all the needs to be sent TBV for the object, upon request; the request should also 

(after the first frame) are translation and rotation parameters, specify the time in the future until which the provided TBV 

possibly as a 4x4 homogeneous transformation matrix A; the should be valid. 

tree B is obtained by multiplying every coordinate in the 15 The algorithm achieves the goal of being output-sensitive 

object's BSP tree by A, and every plane equation by A" 1 . For with respect to the number of dynamic objects by ignoring 

an articulated object, a transformation is needed for each such objects unless they are visible. While the algorithm 

rigid segment For a deformable object, the communication involves some overhead, its amount does not depend lin- 

can include some deformation parameters, or a complete early on the size of the entire scene. For most frames, no 

BSP tree representing the object's current form. 20 time is wasted on updating and displaying invisible dynamic 

The union operation in step 2 can be performed as objects, not even to discover that they are in fact invisible; 

discussed by Naylor et al. 8 they are simply not reached during the traversal of the BSP 

At each user's workstation, all the dyndynamic objects in tree. Hidden dynamic objects require processing only if their 

D are initially marked as visible, and have a time of last TBVs expire or become exposed. If TBVs are chosen with 

observation earlier than the first frame. S is initialized to the 25 sufficient care (e.g. if adaptive expiry is used), then TBV 

union of all the static objects, T and Q are empty, and V exposures only occur for a minority of the invisible objects, 

initially contains the IDs of all the dynamic objects. and TBV expiries become less frequent with time. 

At every frame, the following steps are performed at each Static objects may be regarded as dynamic objects with 

station: zero velocity. However, visible dynamic objects are updated 

1. For each object ID of an expired TBV, as determined by 30 at every frame, and it would be undesirable to "update" 
Q, and for each ID of an object which violated a proba- visible static objects in the same way, especially if this 
bilistic constraint by which its TBV as created, do del_ update takes place over a slow network (although relatively 
TBV(ID); merge leaves if possible. few of the static objects may be visible). Therefore the 

2. T«-S algorithm treats static objects differently from dynamic 

3. For each ID in V do uni_vis(ID). 35 ones. 

4. Operate Naylor's visibility algorithm on T, displaying It will be appreciated that the expiry times At may be 
visible faces. At each leaf of T encountered during this selected according to different criteria to those explained 
traversal, for each ID of an invisible object whose TBV above. For example, the time period At may be constant or 
intersects the leaf, do: set equal to a remaining time duration of the scene. 
(ai del TBVflDV 40 Lfe w i se > if desired, the time period At may be set equal to 
\{ .~~ - y,^ a random time duration or may be inversely proportional to 
(b)um yis(UJJ. m velocity of the respective dynamic object. 

For each ID of ajisible object ^ctmsthe leaf, update *g ^ ^ ablockdi 

the time of last observation assorted wiAIDmV. Upon finally the principal components of a system 

backtracking from a node, merge leaves 11 possible. , . ° , A. J_ r . •* « 

« • ' . f, . ^ r * , , . 45 designated generally as 10 including a processing umt 11 

5. For each dynamic object m V whose time of last obser- °r t & 3 j j- 1 u tu. 

. . 7 " , * » « coupled to a memory medium 12 and a display 13. The 

vanon is earlier than the current frame, do: u , ™7f\ ' #: 

processing umt 11 may be a conventional CPU e.g. pentium 

(a) Obtain a TBV for the object untfl some time m the commercially available from Intel Corporation. However, it 
future; will be appreciated that the system 10 need not be con- 

(b) Insert the TBV into Q and into S; 50 structed using discrete components as depicted in FIG. 11. 

(c) Delete the object's ID from V Thus, by way of further example, the processing unit 11 
Step 1 of the algorithm handles hidden dynamic objects may, if desired, be realized using distributed processing 

whose TBVs have expired by deleting their TBVs and units residing in respective local and remote sites such as in 

moving them to the set V. Note that V contains potentially a network and so on. 

visible dynamic objects, rather than objects which are cer- 55 The processing unit U is adapted to execute the various 

tainly visible; at this stage it is too early to determine certain method steps described in detail above with particular 

visibility, so wc simply bundle the objects whose TBVs have reference to FIGS. 6a to 6c and 7 of the drawings, whilst 

expired with those that are potentially visible because they utilizing a spatial data structure stored in the memory 

were visible in the previous frame. The leaves that should be medium 12. The spatial data structure comprises static 

merged are siblings that contain the same set of IDs after the 60 objects, visible dynamic objects; and temporal bounding 

deletion. volumes each relating to a projected motion of a respective 

In steps 2 and 3, the BSP tree T representing the entire hidden dynamic object during a respective time period At 

scene is constructed. It is used in step 4, the heart of the not necessarily identical for all dynamic objects, 

algorithm . The user application program is executed under control of 

Step 4 displays the scene, and handles exposed TBVs by 65 the processing unit 11 which is responsive to the spatial data 

treating them the same way they would have been handled structure for accelerating the rendering of successive images 

had they expired rather than becoming visible. This step of a scene. 
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In the claims which follow, alphabetic and numeric char- 
acters used to designate claim steps are provided for con- 
venience of description only, and do not necessarily imply 
any particular order of performing the steps. 

The present invention has been described with a certain 
degree of particularity but it should be understood that 
various modifications and alteration may be made without 
departing from the scope or spirit of the invention as defined 
by the following claims. 

We claim: 

1. In a process for rendering a 3-dimensional graphics 
scene comprising a plurality of static and/or dynamic objects 
composed of geometrical elements, a method for accelerat- 
ing the rendering of successive images of said scene com- 
prising the steps o£ 

(a) in an initialization step: 

(i) determining which of the dynamic objects are vis- 
ible and which are hidden at their initial positions, 

(ii) creating temporal bounding volumes for the hidden 
dynamic objects consequent to projected motion 
thereof during a respective time period At not nec- 
essarily identical for all dynamic objects, 

(iii) constructing a spatial data structure containing the 
static objects, the visible dynamic objects at their 
initial positions and the hidden dynamic objects' 
temporal bounding volumes, and 

(iv) maintaining an event queue of the times at which 
the temporal bounding volumes are no longer 
assured to contain their respective dynamic objects, 

(b) inserting the hidden dynamic objects which are no 
longer assured to be contained within their respective 
temporal bounding volumes, either because the event 
queue so reported or because the objects* motion 
violated some assumption by which the temporal 
bounding volumes were created, into the spatial data 
structure instead of the respective temporal bounding 
volumes, 

(c) output-sensitively processing the spatial data structure 
so as to render its visible parts and so as to replace 
visible temporal bounding volumes by their respective 
dynamic objects, 

(d) creating temporal bounding volumes for the hidden 
dynamic objects which do not already have temporal 
bounding volumes, inserting said temporal bounding 
volumes into the spatial database instead of the hidden 
dynamic objects and inserting into the event queue the 
times at which the temporal bounding volume will no 
longer be assured to contain their respective dynamic 
objects, and 

(e) repeating steps (b) to (d) for each image to be 
rendered. 

2. For use with the method according to claim 1, an 
initialization step comprising: 

(i) determining which of the dynamic objects are visible 
and which are hidden at their initial positions, 

(ii) creating temporal bounding volumes for the hidden 
dynamic objects consequent to projected motion 
thereof during a respective time period At not neces- 
sarily identical for all dynamic objects, 

(iii) constructing a spatial data structure containing the 
static objects, the visible dynamic objects at their initial 
positions and the hidden dynamic objects' temporal 
bounding volumes, and 

(iv) maintaining an event queue of the times at which the 
temporal bounding volumes are no longer assured to 
contain their respective dynamic objects. 
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3. For use with the method according to claim 1, a 
processing step comprising: 

(b) inserting the bidden dynamic objects which are no 
longer assured to be contained within their respective 

5 temporal bounding volumes, either because the event 
queue so reported or because the objects' motion 
violated some assumption by which the temporal 
bounding volumes were created, into the spatial data 
structure instead of the respective temporal bounding 

l° volumes, 

(c) output-sensitively processing the spatial data structure 
so as to render its visible parts and so as to replace 
visible temporal bounding volumes by their respective 
dynamic objects, 

(d) creating temporal bounding volumes for the hidden 
dynamic objects which do not already have temporal 
bounding volumes, inserting said temporal bounding 
volumes into the spatial database instead of the hidden 

20 dynamic objects and inserting into the event queue the 
times at which the temporal bounding volume will no 
longer be assured to contain their respective dynamic 
objects, and 

(e) repeating steps (b) to (d) for each image to be 
25 rendered. 

4. The method according to claim 1, wherein a potentially 
visible dynamic object list is created of all potentially visible 
dynamic objects and step (a) includes the steps of: 

(i) initializing the potentially visible dynamic object list to 
30 contain all dynamic objects and the event queue to be 

empty, and 

(ii) if said scene contains static objects, constructing a 
spatial data structure containing the static objects; and 
step (b) comprises the steps of: 

35 (iii) inserting the Ridden dynamic objects which are no 
longer assured to be contained within their respective 
temporal bounding volumes, either because the event 
queue so reported or because the objects' changes 
violated some, assumption by which the temporal 

40 bounding volumes were created, into the potentially 
visible dynamic object list, and 
(iv) obtaining the current position of every object in the 
potentially visible dynamic object list and inserting it 
into the spatial data structure; 

45 there being further included the steps of constantly updat- 
ing the potentially visible dynamic object list as pre- 
viously hidden dynamic objects become visible and as 
previously visible dynamic objects become hidden. 

5. The method according to claim 1, wherein a potentially 
50 visible dynamic object list is created of all potentially visible 

dynamic objects and step (a) includes the steps of: 

(i) initializing the potentially visible dynamic object list to 
contain all dynamic objects and the event queue to be 

5S empty, and 

(ii) if said scene contains static objects, constructing a 
spatial data structure containing the static objects. 

6. The method according to claim 1, wherein a potentially 
visible dynamic object list is created of all potentially visible 

50 dynamic objects and step (b) includes the steps of: 

(i) inserting the hidden dynamic objects which are no 
longer assured to be contained within their respective 
temporal bounding volumes, either because the event 
queue so reported or because the objects* changes 

65 violated some assumption by which the temporal 
bounding volumes were created, into the potentially 
visible dynamic object list, and 
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(ii) obtaining the current position of every object in the 
potentially visible dynamic object list and inserting it 
into the spatial data structure; 

there being further included the steps of constantly updat- 
ing the potentially visible dynamic object list as pre- 
viously hidden dynamic objects become visible and as 
previously visible dynamic objects become hidden. 

7. The method according to claim 1, wherein the spatial 
data structure is hierarchical and step (c) is performed 
recursively. 

8. The method according to claim 7, wherein the spatial 
hierarchical data structure is an octree. 

9. The method according to claim 7, wherein the spatial 
hierarchical data structure is an Binary Space Partitioning 
(BSP) tree. 

10. The method according to claim 7, wherein the spatial 
hierarchical data structure is a k-D tree. 

11. The method according to claim 1, wherein the spatial 
data structure is a regular grid and step (c) is performed 
iteratively. 

12. The method according to claim 1, wherein step (d) is 
based on a predetermined object script in respect of at least 
one of the dynamic objects. 

13. The method according to claim 1, wherein step (d) is 
based on predetermined motion and/or deformation con- 
straints in respect of at least one of the dynamic objects. 

14. The method according to claim 1, for eliminating 
unnecessary communications in a distributed system. 

15. The method according to claim 1, for ray tracing a 
graphic object which is not necessarily seen directly but may 
be reflected by another graphic object or seen through 
another semi-transparent object or casts a shadow on another 
object 

16. The method according to claim 1, further including the 
step of displaying the resulting graphic images on a com- 
puter screen. 

17. The method according to claim 1, wherein: 
the scene is viewed firom a stationary viewpoint, 

most of the hidden dynamic objects are hidden by static 
objects, and 

the time periods At are calculated exactly by starting with 
an initial time period At of one frame, repeatedly 
doubling the time period At until the bounding volume 
is no longer hidden by static objects, and then using 
binary search to find the exact moment at which the 
bounding volume starts to become visible. 

18. The method according to claim 1, wherein the scene 
is viewed from a non-stationary viewpoint, and the time 
period At is reduced from an initial maximum value suitable 
for a stationary viewpoint so as to reduce the bounding 
volumes and thereby increase the time required for the 
hidden dynamic object to be revealed. 

19. The method according to claim 1, wherein the time 
period At is adapted in order that if a previous time period 
for a dynamic object's temporary bounding volume were too 
short such that the temporary bounding volume expired 
before the dynamic object was revealed, then a successive 
temporary bounding volume for the same dynamic object is 
created for a longer validity period, and vice versa. 

20. The method according to claim 1, wherein the time 
period At is constant 

21. The method according to claim 1, wherein the time 
period At is set equal to a remaining time duration of the 
scene. 
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22. The method according to claim 1, wherein the time 
period At is set equal to a random time duration. 

23. The method according to claim 1, wherein the time 
period At is inversely proportional to the velocity of the 

5 respective dynamic object. 

24. The method according to claim 1, wherein steps (b) 
and (d) are based on probabilistic motion and/or deformation 
constraints: Le. constraint which the objects are not neces- 
sarily guaranteed to obey at all times, but only assumed to 
obey with some degree of probability. 

25. A memory medium containing a spatial data structure 
accessible to a user application program for accelerating the 
rendering of successive images of a scene; the spatial data 
structure comprising: 

static objects and/or visible dynamic objects; and 
15 temporal bounding volumes each relating to a projected 
motion of a respective hidden dynamic object during a 
respective time period At not necessarily identical for 
all dynamic objects. 

26. A memory medium containing a user application 
20 program for accelerating the rendering of successive images 

of a scene; the user application program utilizing a spatial 
data structure comprising static objects, visible dynamic 
objects, and temporal bounding volumes each relating to a 
projected motion of a respective bidden dynamic object 
25 during a respective time period At not necessarily identical 
for all dynamic objects; 

said user application program performing the following 
steps: 

^ (a) inserting the hidden dynamic objects which are no 
longer assured to be contained within their respective 
temporal bounding volumes, either because the event 
queue so reported or because the objects' morion 
violated some assumption by which the temporal 

35 bounding volumes were created, into the spatial data 

structure instead of the* respective temporal bounding 
volumes, 

(b) output-sensitively processing the spatial data struc- 
ture so as to render its visible parts and so as to 

w replace visible temporal bounding volumes by their 

respective dynamic objects, 

(c) creating temporal bounding volumes for the hidden 
dynamic objects which do not already have temporal 
bounding volumes, inserting said temporal bounding 

45 volumes into the spatial database instead of the 

hidden dynamic objects and inserting into the event 
queue the times at which the temporal bounding 
volume will no longer be assured to contain their 
respective dynamic objects, and 

5Q (d) repeating steps (a) to (c) for each image to be 
rendered. 

27. In a process for rendering a 3-dimensional graphics 
scene comprising a plurality of static and/or dynamic objects 
composed of geometrical elements, a method for obviating 

55 redundant processing of hidden dynamic objects in succes- 
sive images of said scene so as thereby to accelerate the 
rendering of successive images of said scene; the method 
including in respect of each hidden dynamic object: 

(a) predicting a time period At during which said hidden 
dynamic object is assumed to remain hidden; and 

(b) during said time period At, not rendering said hidden 
dynamic object so as to output-sensitively process the 
scene. 

* * * * * 
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